Improved phase-to-height mapping method combine with device attitude

Phase-to-height mapping is one of the important processes in three dimensional phase measurement profilometry. But, in traditional phase-to-height mapping method, the measurement accuracy is affected by device attitude, so it needs saving a large amount of mapping equations to achieve high-quality phase-to-height mapping. In order to improve that, this paper proposes an improved phase-to-height mapping method combine with device attitude. Firstly, we get the unwrapped phase of the target. Then, using generalized regression neural network is used to reduce the offset of phase information at the same height due to the randomness of device attitude. Last, the phase-to-height mapping is completed by substituting the unwrapped phase (the difference between having detected object and no detected object) of eliminate the offset into improved phase-to-height mapping method. Experimental results show that the proposed method could achieve high-quality phase-to-height mapping with less mapping equation and less memory space. Compared with the nonlinear phase-to-height mapping method (probabilistic neural network to eliminate phase offset), its accuracy is improved by 44.30%. Compared with the nonlinear phase-to-height mapping method (radial basis function neural network to eliminate phase offset), the accuracy is improved by 39.58%.

www.nature.com/scientificreports/light procession (DLP) projector and industrial camera on the unwrapped phase (the difference between having detected object and no detected object) in the PMP system, and uses generalized regression neural network (GRNN) to eliminate the influence of the unwrapped phase offset caused by the above reasons, so that the influence on the unwrapped phase at the same height is greatly reduced.Then, we substitute the unwrapped phase obtained before into the proposed method to achieve high quality phase-to-height mapping.

Error analysis
Nowadays, the commonly used phase-to-height mapping methods include: explicit phase-to-height mapping method and implicit phase-to-height mapping method.The explicit phase-to-height mapping method involves many calibration parameters, and the calibration process is relatively complicated, so it is not only complex to implement, but also easy to introduce additional errors.The commonly used equation of the implicit phase-toheight mapping method is nonlinear phase-to-height mapping method, as shown in Eq. (1) [14][15][16][17] , Where, α(x, y) , β(x, y) and γ (x, y) are the three fitting parameters.
The above nonlinear phase-to-height mapping method does not need to obtain the internal and external parameters of the system, and includes the distortion and nonlinearity of the system in the parameter fitting process, and directly uses several unwrapped phase of known heights to fit the relationship between phase and height.However, there are still some problems, which are analyzed as follows.
Figure 1 shows the projected fringe image in the actual environment.By observing and comparing region 1 and region 2 in Fig. 1, it could be seen that the edge of the projected fringe image is obviously distorted.By observing and comparing region 3 and region 4 in Fig. 1, it could be seen that the width of the fringe in the projected image at different positions has changed.It could be seen from the analysis that the installation attitude of DLP projector causes a certain offset in the corresponding unwrapped phase of the target of the same height, as shown in Fig. 2: (1)  Figure 2 shows the unwrapped phase of different heights gauge blocks.The height of gauge blocks is 15 mm, 15 mm and 25 mm from left to right.Since the output height h(x, y) of Eq. ( 1) is only related to the unwrapped phase ψ(x, y) , if the phase-to-height mapping of all pixel positions adopts only one or several correlation map- ping equations, this scheme is difficult to achieve in principle due to the influence of the above unwrapped phase offset.If a correlation mapping equation is obtained for each pixel position, the correlation mapping equation cannot be generalized, and a large amount of memory space is required to store the mapping equation, which greatly limits the practicability of this method.Therefore, it is very important to propose a method that could consider the device attitude and achieve high quality phase-to-height mapping with fewer mapping equations.

The proposed method
In order to obtain a new high-quality phase-to-height mapping method, we carry out the following analysis: First, the unwrapped phases of reference plane in different measured heights (the measured height is the distance between the camera or the DLP projector and the measured surface) are respectively got and denote as ψ , where: ψ thre is the threshold of phase error judgment, and its effect is shown in Fig. 4.
Based on the analysis of Fig. 4, it could be seen that due to the influence of the attitude of DLP projectors, industrial cameras and other device, the unwrapped phase corresponding to the same height have a certain offset, and the unwrapped phase offset has a certain correlation with its coordinate and GRNN is a kind of local approximation neural network, which has the advantages of strong nonlinear mapping ability, good robustness and flexible network structure, so it is often used to solve nonlinear problems 18,19 .In view of this, we introduce GRNN to eliminate the influence of device attitude on phase information, so that the phase offset in the unwrapped phase corresponding to the same height is greatly reduced: (2)  www.nature.com/scientificreports/ Step 1 The coordinates (x, y) of the unwrapped phase offset are taken as inputs and the offset of unwrapped phase at corresponding coordinates are taken as outputs to train the GRNN model, as shown in Eq. ( 3): Step 2 Let ψ unwrap diff subtract ψ unwrap offset to get the phase difference of the unwrapped phase that eliminates the effect of the unwrapped phase offset, denote as ψ ′unwrap diff , as shown in Eq. ( 4) : Step 3 Substitute ψ ′unwrap diff as input into the phase-to-height implicit mapping method to obtain high-quality phase-to-height mapping results.
Summarizing the above, as shown in Eq. ( 5) : Based on the above analysis, this paper proposes an improved phase-to-height mapping method combine with device attitude, the pseudo-code is shown as follows: Algorithm.Improved phase-to-height mapping method.
In this experiment, we use a projector to project fringe images onto several sets of white ceramic gauge blocks of different heights (15 mm, 25 mm, 30 mm and 40 mm) on the reference plane and the reference plane.Then, the fringe images capturing by industrial cameras are analyzed to obtain the unwrapped phase of the reference plane and the unwrapped phase modulated by the white ceramic gauge blocks of different heights.Next, the unwrapped phases containing the height information of the gauge blocks subtract the unwrapped phase of the reference plane to obtain the phase difference.Finally, the measurement results are calculated according to the proposed method.
In order to verify the superiority of the proposed method, we set up a comparison experiment to compare with the proposed method, and we choose the following methods to conduct the comparison experiment: direct phase-to-height mapping method (reference 11 , denote as method 1), nonlinear phase-to-height mapping method (reference 12,13 , denote as method 2), phase-to-height mapping method (probabilistic neural network (PNN) to eliminate phase offset, denote as method 3), and phase-to-height mapping method (radial basis function (RBF) neural network to eliminate phase offset, denote as method 4).We record the size of the memory space occupied by mapping equations about different mapping methods (sufficient training samples, the amount is limited only by computer memory), as shown in Table 1, and abandon fitting of the corresponding coordinate when the phase or height is infinite.
It could be seen from Table 1 that the memory space required for method 1 and method 2 is relatively large and cannot be used in many cases.For better comparison, we make method1(method 2) only have a mapping equation for the measurement system in this paper.In this case, method 1(method 2) is denoted as method 1-2 (method 2-2).
(3) Then we randomly select 150 phase-to-height conversion results of the same coordinates among all the results of different methods and compared them with their real height, as shown in Fig. 6.
In Fig. 6, 'Real data' are the phases to the real height measured objects by using hardware equipment and 'Predictive data' are the height information obtained through phase mapping using the proposed method.As could be seen from above, the proposed method could get height information corresponding to all phases within the defined domain.So it has great practicality and the error fluctuation of the height obtained by the proposed method is smaller than other comparison methods.Therefore, it is concluded from the above experimental analysis that the proposed method could achieve high-quality phase-to-height mapping.In order to more accurately analyze the performance and accuracy of the proposed method, we randomly selected different height gauge blocks, and then calculated the root mean square error (RMSE) [25][26][27] between the real height and the predictive height by different methods of the gauge block in some of its regions, we substitute the phase of 'Real data' into mapping equations, obtaining the data related to 'Real data' in 'Predictive data' and record it in Table 2. Where: The classification mechanism in this paper is as follows: The total number of each group data is guaranteed to be 150 groups, and the data that does not meet the region threshold is defined as zero.
As could be seen from Table 2, in most areas, the RMSE calculate by the proposed method for different heights is the smallest.Compared with method 1-2, the accuracy of the proposed method is improved by 39.44%.Compared with method 2-2, the accuracy of the proposed method is improved by 40.10%.Compared with method 3, the accuracy of the proposed method is improved by 44.30%.Compared with method 4, the accuracy of the proposed method is improved by 39.58%.From the above analysis, it could be concluded that the proposed method could achieve higher-quality phase-to-height mapping with fewer mapping equations.

Conclusion
In this paper, an improved phase-to-height mapping method combine with device attitude is proposed.Firstly, it is concluded that the unwrapped phase will be offset due to the influence of the device attitude in the PMP system.To solve this problem, this method uses GRNN to eliminate the phase offset.Finally, the unwrapped phase of eliminating the phase offset is substituted into the phase-to-height mapping equation, and the phase information is mapped to the height information with high quality.In order to verify the proposed method, a comparison experiment is carried out between the proposed method and the comparison method.Experimental results show that the proposed method has higher measurement accuracy with using less memory space.Compared with direct phase-to-height mapping method and nonlinear phase-to-height mapping method, the proposed method greatly reduces the memory space of mapping equations.Compared with the phase-to-height mapping method using PNN to eliminate phase offset, the measurement accuracy of the proposed method is improved by 44.30%.Compared with the phase-to-height mapping method of using RBF neural network to eliminate phase offset, the  www.nature.com/scientificreports/measurement accuracy of proposed method is improved by 39.58%.However, this paper do not further analyze the phase offset and its related factors, only use the phase offset at rated height as input to the GRNN.This still some phase error in the result.In future research, we will explore this issue.The proposed method provides a new idea and theoretical basis for the application of phase-to-height mapping method.

Figure 1 .
Figure 1.Projected fringe image in the actual environment.

Figure 2 .
Figure 2. Unwrapped phase of different heights gauge blocks.

unwrap 1 and ψ unwrap 2 .and ψ unwrap 2 into
The effect diagram is shown in Fig.3:Then, we substitute ψ unwrap 1 Eq.(2) to obtain the phase difference of the two unwrapped phases, denote as ψ unwrap diff

Figure 3 .
Figure 3. Unwrapped phase of different measured heights.

Table 1 .
The size of the memory space occupied by mapping equations about different mapping methods.

Table 2 .
RMSE between the predictive height obtained by different methods and the real height.